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Abstract. Following an early claim by Nelson & McEvoy [19] suggest- 
ing that word associations can display 'spooky action at a distance be- 
haviour', a serious investigation of the potentially quantum nature of 
such associations is currently underway. This paper presents a simple 
quantum model of a word association system. It is shown that a quantum 
model of word entanglement can recover aspects of both the Spreading 
Activation model and the Spooky model of word association experiments. 

1 Modelling Words and Meaning 

Human beings are adept and drawing context-sensitive associations and infer- 
ences across a broad range of situations ranging from the mundane to the creative 
inferences that lead to scientific discovery. Such reasoning has a strong pragmatic 
character and is transacted with comparatively scarce cognitive assets. However, 
despite our apparent proficiency at drawing inferences, and our ability to express 
words in such a manner that other people can (usually) understand the meaning 
that we are trying to convey, our theoretical understanding of how this process 
occurs has been slow to develop. 

The field of cognitive science has recently produced an ensemble of semantic 
models which have an encouraging, and at times impressive track record of repli- 
cating human information processing, such as human word associations norms 
[16, 4, 14, 15, 11, 12, 24, 13, 25]. The term "semantic" derives from the intuition 
that words seen in the context of a given word contribute to its meaning, or, 
more colloquially expressed, the meaning of a word is derived from the "company 
it keeps" [8] . In order to progress in our understanding of how meaning is gener- 
ated from sets of words in a language we must understand the way in which the 
mental lexicon of that language is generated during language acquisition, and 
how it works once created in the mind of a specific individual. 

1.1 The Mental Lexicon 

The mental lexicon of a language refers to the words of a language, but its struc- 
ture is represented by the associative links that bind this vocabulary together. 
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Such links are acquired through experience and the vast and semi-random na- 
ture of this experience ensures that words within this vocabulary are highly 
interconnected, both directly and indirectly through other words. For example, 
during childhood development and the associated acquisition of English, the 
word planet becomes associated with earth, space, moon, and so on. Even within 
this set, moon can itself become linked to earth and star etc. Words are so as- 
sociatively interconnected with each other that they meet the qualifications of 
a 'small world' network wherein it takes only a few associative steps to move 
from any one word to any other in the lexicon [26] . Because of such connectivity 
individual words are not represented in long-term memory as isolated entities 
but as part of a network of related words. However, depending upon the context 
in which they are used, words can take on a variety of different meanings and 
this is very difficult to model [7]. 

Much evidence shows that for any individual, seeing or hearing a word ac- 
tivates words related to it through prior learning. Understanding how such ac- 
tivation affects memory requires a map of links among known words, and free 
association provides one reliable means for constructing such a map [21]. In 
free association experiments, words are presented to large samples of partici- 
pants who produce the first associated word to come to mind. The probability 
or strength of a pre-existing link between words is computed by dividing the 
production frequency of a response word by its sample size. For example, the 
probabilities that planet produces earth and mars are 0.61 and 0.10, respec- 
tively, and we say that earth is a more likely or a stronger associate of planet 
than mars. 

Just like the nonlocality experiments of quantum theory, human memory 
experiments require very careful preparation of the state to be tested. For ex- 
ample, in extralist cuing, participants typically study a list of to-be-recalled 
target words shown on a monitor for 3 seconds each (e.g., planet). The study 
instructions ask them to read each word aloud when shown and to remember 
as many as possible, but participants are not told how they will be tested until 
the last word is shown. The test instructions indicate that new words, the test 
cues, will be shown and that each test cue is related to one of the target words 
just studied (e.g., universe). These cues are not present during study (hence, 
the name extralist cuing). As each cue is shown, participants attempt to recall 
its associatively related word from the study list. In contrast, during intralist 
cuing the word serving as the test cue is presented with its target during study 
(e.g., universe planet). Participants are asked to learn the pairing, but otherwise 
the two tasks are the same. It appears that more associate-to-associate links 
benefit recall, and two competing explanations for this phenomenon have been 
proposed: Spreading Activation, and Spooky Activation At a Distance. 

This paper will demonstrate an intriguing connection between these two ex- 
planations, obtained by making the assumption that words can become entangled 
in the human mental lexicon. 
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1.2 Isn't Entanglement Correlation? 

Entanglement is a phenomenon unique to quantum behaviour. If a system con- 
sisting of two components becomes entangled then it cannot be thought of as 
separate anymore; a description of one component without reference to the other 
will, in some cases, fail. Indeed, an entangled quantum system will generally 
exhibit an intercomponcnt agreement with reference to any combination of mea- 
surement settings. This is of particular importance for a system that becomes 
spatially extended, as in the case where the two components are taken a long 
way from each other. Here we find that quantum systems display correlation 
instantaneously in response to what might even be a delayed choice of measure- 
ment setting [1], and yet cannot be used to transmit information between two 
observers, and thus does not actually violate Special Relativity [17]. This is in 
contrast with classical scenarios of correlation. In a classical situation a system 
is in a pre-existing state, and this is discovered through the process of measure- 
ment. Not so with a quantum system, where the process of measurement can 
actively influence the outcome itself. This fundamental difference between the 
two types of system was first alluded to in the by now famous EPR 4 debate, 
but was only inescapably highlighted with the more subtle (and recent) results 
surrounding the contextuality of quantum systems (see [10] or [2] for a good in- 
troduction to these ideas). An entangled quantum system is very different from 
a correlated classical system; no pre-existing elements of reality [6] have been 
found that can explain the agreement that is obtained between distant measuring 
devices that are set to determine the state of a quantum system. 

To make these ideas more concrete, let us consider a specific example of clas- 
sical correlation. If the same number is written on two pieces of paper, enclosed 
in two envelopes, and sent to Alice and Bob at two distant ends of the Universe, 
the information obtained upon opening of one of the envelopes will instantly 
correlate with the state of the other envelope at the other end of the universe. 
However, these correlated pieces of paper are not entangled. The number on the 
two pieces of paper can be regarded as a hidden variable, or clement of reality; 
even before we open the envelope it exists, in both envelopes. Upon opening the 
envelope at one end of the Universe we find out what that number is, and hence 
know what number is already inscribed upon the other piece of paper. The quan- 
tum analogue of this scenario would be far stranger. The situation most similar 
to the nonlocal effects exhibited by entangled quantum systems would involve 
Alice, at one end of the Universe choosing to write a number upon her blank 
piece of paper when she opens her envelope, and then finding that Bob, upon 
opening his envelope found exactly the same number upon his piece of paper at 
the other end of the Universe. Obviously this does not happen. 

However, we might ask if similar cases of intcrcomponent dependency, or 
spooky-activation-at-a-distance, exist for systems beyond the field of physics. 

We shall now look at the problem of modelling associate-to-associatc links in 
the human mental lexicon, before showing how the assumption that associates 
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might be entangled in a subject's cognitive state can lead to a new model of 
word associations. 



2 Modelling Associate-to-associate Links 

Figure 1 shows a hypothetical target word having two target-to-associate links 
in a subject's cognitive state. There is also an associate-to-associate link between 




Fig. 1. A hypothetical target with two associates and single associate-to-target and 
associate-to-associate links. From Nelson, McEvoy, and Pointer ([20]). 



Associates 1 and 2, and an associatc-to-target link from Associate 2 to the Target 
t. The values on the links indicate relative strengths estimated via free associa- 
tion. Nelson et al. have investigated reasons for the more likely recall of words 
having more associate-to-associate links [20]. Two competing explanations for 
why associate-to-associate links benefit recall have been proposed. 

The first is the Spreading Activation equation, which is based on the classic 
idea that activation spreads through a fixed associative network, weakening with 
conceptual distance (e.g., [5]): 

n n n 

s(t) = Yl s *i s * + E E StiSijSjt (i) 

i—l i—l j — 1 

= (.10 x .70) + (0.20 x 0.60 x 0.70) (2) 
= 0.154 (3) 

where n is the number of associates and i ^ j. S(t) denotes the strength 
of implicit activation of target t due to study, Su target-to-associate activa- 
tion strength, Su associate-to-target activation strength (resonance), and Sij 
associate-to-associate activation strength (connectivity) . Multiplying link strengths 
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produces the weakening effect. Activation ostensibly travels from the target to 
and among its associates and back to the target in a continuous chain, and the 
target is strengthened by activation that returns to it from pre-existing con- 
nections involving two and three-step loops. More associate-to-associate links 
create more three-step loops and theoretically benefit target recall by increasing 
its activation strength in long-term memory. Importantly, note that the effects 
of associate-to-associate links are contingent on the number and strength of 
associate-to-target links because they allow activation to return to the target. If 
associate-to-target links were absent, even the maximum number of associate- 
to-associate links would have no effect on recall because activation could not 
return to the target. 

In contrast, in the 'Spooky Activation at a Distance' equation, the target 
activates its associative structure in synchrony: 

n n n n 

i—1 i—1 i—1 j — 1 

= 0.20 + 0.10 + 0.70 + 0.60 (5) 
= 1.60 (6) 

where i + 1 j; Su, target-to-associate i strength; Su, associate i-to-target strength 
(resonance) ; Sij , associate i-to-associate j strength (connectivity) 

This equation assumes that each link in the associative set contributes addi- 
tively to the target's net strength. The beneficial effects of associate-to-associate 
links are not contingent on associate-to-target links. Stronger target activation is 
predicted when there are many associate-to-associatc links even when associate- 
to-target links are absent. In fact, associate-to-target links are not special in 
any way. Target activation strength is solely determined by the sum of the link 
strengths within the target's associative set, regardless of origin or direction. 

3 Entanglement of Words 

How should we represent the combination of words in the human mental lexicon? 
QT uses the tensor product, ®, to denote composite systems. Consider the case 
of m = 2 study words: u and v presented to a group of subjects. Let us assume 
that, when cued, the subjects recall neither target word. In this case we could 
write: 

|u) ® \ v ) = |0) ® |0> = |00) (7) 

where the notation 1 00) is just shorthand for the tensor product state |0) (g> |0) 
describing the composite system of two negative outcomes. If word u alone was 
recalled then we would write \u) (g> \v) = |10), whereas in the converse case we 
would write |01) and finally, if both words were recalled then the tensor product 
would yield the state |11). 

However, this straightforward scenario is not the only form of situation pos- 
sible in the quantum formalism. Superposition states can also occur, and these 
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are important as they can represent the situation where the words u and v may 
be more likely to be recalled in one context than another. Assume that we can 
represent one subject's cognitive state with reference to the combined targets u 
and v as a 2 q-h\t register that refers to their states of 'recalled' and 'not re- 
called' in combination. Thus, if we represent the target words using the standard 
superpositions \u) = a |0) + ai|l) and \v) = b \0) + &i|l), (where Oq + a\ = 1 
and 6q + b\ = 1), then it is possible to denote the state of the combined system 
by writing the tensor product 

|u> ® \v) = (a |0) + oi|l)) ® (6o|0) + 6x11)) (8) 
= a fe |00) +oi6o|10) +a 6i|01) +a 1 6 1 |ll), (9) 

where |ao&o| 2 + |ai^o| 2 + |«o^i| 2 + |ai&i| 2 = 1- This is the most general state 
possible. It represents a quantum combination of the above four possibilities, 
obtained using a tensor multiplication between the states \u) and \v). In contrast 
to the simple cases discussed above, here no state of recall is 'the' state, rather, 
we must cue the subject and elicit a response from them before we can talk 
about a word being 'recalled' or 'not recalled'. Indeed, a different cue might 
elicit a very different response, and the quantum formalism could deal with this 
via a change of basis. 

It is important to realise however, that (9) is not the only form of state that 
can be obtained from combination of \u) and \v) in the quantum formalism. 

The other form of state, an entangled state is one that it is impossible to write 
as a product. As an example of an entangled state, we might consider the the 
state V where the words u and v are either both recalled, or both not recalled in 
relation to a cue q. One representation of this scenario is given by the following 
state: 

V=^(|oo> + |ii». (10) 

This seemingly innocuous state is one of the so-called Bell states in QT. It is 
impossible to write as a product state, thus it differs markedly from (9) . The fact 
that entangled systems cannot be expressed as a product of the component states 
makes them non-separable. More specifically, there are no coefficients which can 
decompose equation (10) into a product state exemplified by equation (9) which 
represents the two components of the system, u and v, as independent of one 
another. For this reason ip is not written as \u) ® \v) as it can't be represented 
in terms of the component states \u) and \v). 

4 An Analysis of Spooky-activation-at-a-distance in 
Terms of Entanglement 

Nelson and McEvoy have recently begun to consider the Spooky-activation- 
at-a-distancc formula in terms of quantum entanglement, claiming that "The 
activation-at-a-distance rule assumes that the target is, in quantum terms, en- 
tangled with its associates because of learning and practicing language in the 
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0.7 








Pt = 0.7 


p ai = 0.2 


Pa 2 = 0.7 



Table 1. Matrix corresponding to hypothetical target shown in Figure 1 



world. Associative entanglement causes the studied target word to simultane- 
ously activate its associate structure" [19, p3]. The goal of this section is to 
formalise this intuition. At the outset, it is important that the quantum for- 
malism be able to cater for the set size and connectivity effects described else- 
where [3]. Recall both set size and associative connectivity have demonstrated 
time and again robust effects on the probability of recall. Because the Spooky- 
activation-at-a-distance formula sums link strengths irrespective of direction, it 
encapsulates the idea that a target with a large number of highly interconnected 
associates will generate a high activation level during study. 

Table 1 is a matrix representation of the associative network of the hypo- 
thetical target t shown in Figure 1. The last line of the matrix represents the 
summation of free association probabilities for a given word. For example, 

Pa 2 =Pr(a 2 |t)+Pr(a 2 |ai) (11) 
= 0.1 + 0.6 (12) 
= 0.7 (13) 

These free association probabilities may be added as it is assumed that each 
free association experiment is independent, that is associate a 2 being recalled 
in relation to cue t is assumed independent of it being recalled in relation to 
the cue a\. Since free association experiments require a subject who has not 
been primed in any way beyond that provided by the cue, this appears to be a 
reasonable simplifying assumption. 

Both Spreading Activation and Spooky-activation-at-a-distance approaches 
assume that free association probabilities determine the strength of activation of 
a word during study; they only differ in the way this activation strength is com- 
puted. Viewing free association probabilities in this way allows the matrix to be 
considered as a many bodied quantum system modelled by three qubits. Figure 2 
depicts the system, here, each word is in a superposed state of being activated 
|1), or not |0). Note how each summed column with a non-zero probability leads 
to a qubit. 

For ease of exposition in the following analysis, we shall change variables. The 
probabilities depicted in table 1 are related to the probability densities of figure 2 
by taking their square root: e.g. 717 = p t . Using such a change of variables, the 
state of the target word t would be written as: 



\t) = VWt\0)+^Pt\l) = n t \0)+7T t \l), 



(14) 
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I0> 



I0> 



I0> 



la,> 





ll> 



ll> 



ll> 



Fig. 2. Three bodied quantum system of words. 



where the probability of recall due to free association is p t — 7tf , and p t — 1 — pt = 
€ t 2 represents the probability of a word not being recalled. Thus, the states of 
the individual words arc represented as follows in order to avoid cluttering the 
analysis with square root signs: 



where if t = 1 - w t , n ai = 1 - ir ai and n a2 = 1 - ir a2 . 

As detailed in the previous section, tensor products are used to model many 
bodied quantum systems. The state ip t of the most general combined quantum 
system is given by the tensor product of the individual states: 



=7r t 7r ai 7r a2 |000) + 7r t 7r ai 7r a2 |100> + 7r t 7r ai 7r a2 |010) + 7r 4 7r ai 7r a2 |110) 

+ 7f t 7f ai 7T a2 |001) + 7T t 7f ai 7r a2 |101) + 7f t 7T ai 7T a2 1 01 1) + 7T t 7T ai 7T a2 1 1 1 1) 

The intuition behind this expression is an enumeration of the possibilities of 
the states of the qubits. So, |111) represents the state in which all respective 
qubits collapse onto their state |1). In other words, 1 1 1 1} denotes the state of 
the system in which words t, ai and a-i have all been activated due to study of 
target t. The probability of observing this is given by the taking the square of 
the product 7r t 7r ai 7r a2 . Conversely, the state |000) corresponds to the situation 
in which none of the words have been activated. 

The state ipt of the three-bodied system does not capture Nelson & McEvoy's 
intuition that the studied target word t simultaneously activates its associative 
structure. Recall their suggestion that target t activates its associates in syn- 
chrony: When target t is studied it activates all of its associates, or none at all. 
Interestingly, this idea is quite easily captured by the assumption that the state 
ipt evolves into a Bell entangled state ip' t of the form: 



\t) 

K) 

\ai) 



7ft|0)+7T t |l) 
7fai|0)+7T Ol |l) 
7Ta 2 |0) +7T a2 |l) 



(15) 
(16) 

(17) 



ipt =\t) ® |ai) ® \a 2 ) 

= (Wt 1 0) + TT t 1 1 ) ) ® (tt ai 1 0) + 7T Q1 1 1) ) ® (n a2 1 0) + ir a2 1 1 ) ) 



(18) 
(19) 



$ = Vpo looo) + vpT| in) • 



(21) 
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This formula represents a superposed state in which the entire associative struc- 
ture of a subject is in a state of potential activation (|111)) or potential non- 
activation (| 000)), with the probabilities of these states occurring given by po 
and pi respectively. 

How should we ascribe values to the probabilities p and pi? In QT these 
values would be determined by the unitary dynamics evolving i\) t into ip' t . As 
such dynamics are yet to be worked out for cognitive states, we are forced to 
speculate. One approach is to assume the lack of activation of the target is 
determined solely in terms of lack of recall of any of the associates. That is, 

Po = PtP ai Pa 2 (22) 

Consequently, the remaining probability mass contributes to the activation of the 
associative structure as a whole. Thus, starting from the assumption of a Bell 
entangled state, we find that the probability pi expresses Nelson & McEvoy's 
intuition: 



Pl = 1 - PtP ai Pa 2 (23) 

= \-{l-p t ){l-p ai ){l-p a2 ) (24) 

= 1 - (1 -p t -p ai +p t p ai -Pa 2 +PtPa 2 +P ai Pa 2 ~ PtPa x Pa 2 ) (25) 

= Pt +P ai + Pa 2 + PtP ai Pa 2 - (PtP ai +PtPa 2 + P ai Pa 2 ) (26) 
A B C 



Term A corresponds to the summation of the free association probabilities in 
the above matrix. In other words, term A corresponds exactly to the Spooky- 
activation-at-a-distance formula (See equation 4). At such, the assumption of 
a Bell entangled state provides partial support for the summation of free asso- 
ciation probabilities which is embodied by the Spooky-activation-at-a-distance 
equation. Ironically perhaps, term B corresponds to free association probabil- 
ities multiplied according to the directional links in the associative structure. 
This is expressed in the second term of the spreading activation formula (See 
equation 1). In other words, departing from an assumption of entanglement leads 
to an expression of activation strength which combines aspects of both Spooky- 
activation-at-a-distance and Spreading Activation. 

The third term C is more challenging to interpret. In a more complete model 
capable of generating some form of evolutionary dynamics we might expect that 
it would arise from the underlying structure of the Hilbcrt space used. Here, it 
has arisen from apparently sensible assumptions about how probabilities should 
be amassed in the the Bell entangled state. What significance can be drawn 
from this term? The beginnings of an answer can be formulated by returning to 
figure 1 . When seen in the context of actual values, the term C has a significant 
compensating effect, subtracting 0.77 from the summation of the Spooky term 
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with the spreading activation term: 
Pi = A + B - C 



(27) 



= (0.7 + 0.2 + 0.7) + (0.7 x 0.2 x 0.7) 

- (0.7 x 0.2 + 0.7 x 0.7 + 0.2 x 0.7) 

= 0.928 



(28) 



(29) 



Thus, according to this analysis, the strength of activation pi lies somewhere 
between Spreading Activation and Spooky-activation-at-a-distance. Based on a 
substantial body of empirical evidence, Nelson and McEvoy have argued persua- 
sively spreading activation underestimates strength of activation [23]. Here we 
have seen that when departing from an assumption that the associative structure 
is Bell entangled, a cautious preliminary conclusion is that Spooky-activation- 
at-a-distance overestimates the strength of activation and it is term C which 
compensates for this. 

We conclude this section with some remarks how the entanglement model 
above assists in the explanation of some experimental results that have not been 
well accounted for in current models of the mental lexicon. Attempts to map the 
associative lexicon soon made it clear that some words produce more associates 
than others. This feature is called 'set size' and it indexes a word's associative 
dimensionality [18, 22]. It was also revealed that the associates of some words 
are more interconnected than others. Some words have many such connections 
(e.g., moon-space, earth- p lan et) , whereas some have none, and this feature is 
called "connectivity" [20]. Thus, experiments have shown that in addition to 
link strengths between words, the set size and connectivity of individual words 
have powerful effects on word recall, which existing theories cannot generally 
explain. 

This is an interesting result for the model suggested here, as according to 
the above analysis we might surmise that the more associates a target has, 
the more qubits are needed to model it. When these are tensored the resulting 
space will have a higher dimensionality. Therefore a large set size is catered 
for by a tensor space of higher dimensionality Conversely, interconnectivity is 
catered for by larger probabilities in the initial superposed states of the respective 
qubits. Consider once again the matrix in table 1. In the general case, when the 
associative structure is highly interconnected the sums of probabilities in the last 
row will tend to be higher. These will contribute to higher activation strength as 
they are summed (as defined by probability pi) in the same way as in Spooky- 
activation-at-a-distance. So it is possible to have a high activation strength even 
though the tensor space has high dimensionality. When the associative structure 
in not interconnected these probabilities will be low and hence lead to lower 
strength of activation. 

5 Conclusions and Future Directions 



Obviously the model presented here is overly simple. The human mental lexicon 
is a vast and highly interconnected network consisting of thousands of words, and 
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its associative structure is far more complex than the simple toy model in figure 1 
could ever hope to represent. However, some promising initial results have been 
obtained from this very simplified analysis. We have seen some evidence that a 
quantum approach can model set size and connectivity effects, and a prediction 
has been made that Spooky-activation-at-a-distance overestimates associative 
behaviour by some factor. While equation (26) makes a very concrete suggestion 
about how large this overestimation might be, it is unlikely that the situation 
will prove this simple. 

Firstly, this is a very basic toy model, addressing the behaviour of only one 
target and two associates. A fully developed theory would have to be stated in 
terms of all the targets and all of their associates. It is very hard to extrapolate 
from this model to a more realistic one. One possibility would involve applying 
the apparatus of Statistical Mechanics in a density matrix approach to model 
sets of targets and their associates, but no results have been obtained here to 
date. A related issue surrounds the meaning of the term C in equation (26) as 
more associative structure is added. Here, we would see C gaining more and 
more terms (since A and B essentially correspond to the two extreme values in 
the expansion of the bracketed term in (24)). This does not seem plausible, and 
the way in which this term would act as it became larger is yet to be established. 

In addition to these immediate issues, much work remains to be done in this 
area. Given the large amount of data collected about word association norms 
[21] we might expect that experiments can be performed that might distinguish 
between the varying predictions of the different models, and work is underway 
to generate results here. A physically and cognitivcly motivated time evolution 
equation capable of generating the Bell-type state (10) is essential before we can 
consider this model to be truly quantum(like) and initial ruminations about how 
this might be achieved are presented in [9]. 

Ending on a slightly more positive note, we consider the most important 
result of this article to be the indication that a straight tensorial combination 
of associate words in the mental lexicon is not particularly representative of the 
intuition that words and their associates are activated in synchrony. Given that 
a Bell-type entangled state provides a far more likely candidate for the behaviour 
of word association networks this result thus provides some first steps towards 
establishing evidence that human cognitive structures have some quantum(likc) 
behaviour. 
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